Bayesian sparse factor analysis with kernelized observations
نویسندگان
چکیده
Multi-view problems can benefit from latent representations since they find low-dimensional projections that fairly capture the correlations among multiple views characterise data. On other hand, high-dimensionality and non-linear issues are traditionally handled by kernel methods, inducing a (non)-linear function between projection data itself. However, usually come with exposition to overfitting. Here, we combine Bayesian factor analysis what refer as kernelized observations, in which proposed model focuses on reconstructing not itself, but its relationship points measured function. In turn, extend previous FA formulations be able relationships means of and, at same time, include additional facilities obtain compact an automatic selection Relevance Vectors (RVs), feature relevance even, learning approach. Besides, this is flexibly included into modular framework where easily adapt capabilities needs them functionalities such heterogeneous or semi-supervised learning. Using several public databases, demonstrate potential approach (and extensions) w.r.t. common multi-view models canonical correlation analysis, incomplete – variational autoenconder manifold determination, shows ability outperform baselines while indistinctly combining extensions.
منابع مشابه
Bayesian group latent factor analysis with structured sparse priors
Latent factor models are the canonical statistical tool for exploratory analyses of lowdimensional linear structure for an observation matrix with p features across n samples. We develop a Bayesian group factor analysis (BGFA) model that extends the factor model to multiple coupled observation matrices. Our model puts a structured Bayesian hierarchical prior on the joint factor loading matrix, ...
متن کاملBayesian Factor Analysis for Multilevel Binary Observations
Multilevel covariance structure models have become increasingly popular in the psychometric literature in the past few years to account for population heterogeneity and complex study designs. We develop practical simulation based procedures for Bayesian inference of multilevel binary factor analysis models. We illustrate how Markov Chain Monte Carlo procedures such as Gibbs sampling and Metropo...
متن کاملKernelized Bayesian Transfer Learning
Transfer learning considers related but distinct tasks defined on heterogenous domains and tries to transfer knowledge between these tasks to improve generalization performance. It is particularly useful when we do not have sufficient amount of labeled training data in some tasks, which may be very costly, laborious, or even infeasible to obtain. Instead, learning the tasks jointly enables us t...
متن کاملSparse Bayesian infinite factor models.
We focus on sparse modelling of high-dimensional covariance matrices using Bayesian latent factor models. We propose a multiplicative gamma process shrinkage prior on the factor loadings which allows introduction of infinitely many factors, with the loadings increasingly shrunk towards zero as the column index increases. We use our prior on a parameter-expanded loading matrix to avoid the order...
متن کاملInference algorithms and learning theory for Bayesian sparse factor analysis
Bayesian sparse factor analysis has many applications; for example, it has been applied to the problem of inferring a sparse regulatory network from gene expression data. We describe a number of inference algorithms for Bayesian sparse factor analysis using a slab and spike mixture prior. These include well-established Markov chain Monte Carlo (MCMC) and variational Bayes (VB) algorithms as wel...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2022
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2022.03.024